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(54) DIGITAL COMPOSITION OF MOSAIC IMAGE 



(57) Abstract: 

PROBLEM TO BE SOLVED: To generate an artistically 
excellent mosaic image by executing a mosaic software 
and generating the mosaic image from a target image and 
a source image. 

SOLUTION: The mosaic image 10 is generated from the 
picked-up source image 12 so as to permit it to 
approximate to the target image 14. A computer work 
station 20 having a video input is used in order to 
pick-up the source image from a video tape player 1 6 and 
a laser disk player 18. A mosaic program reads the 
source image 12 from the selection of a designated 
database, analyzes the target image and selects the 
source image 12 to be used in the respective tiles of 
the mosaic image 10. That is, the source image 12 
provided with resolution corresponding to the number of 
sub-areas which are selected as against the mosaic 
image is loaded into a list where structure is linked. 
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1 

■c, 

■y7°^ 

xfyT't, Srffii, 10 
*^A^«£jfc|g^5Jfc|fc;*yy;/ , -ej[ >0 -c, #y-* 

y-* . j*— zmmx^yyt. 

^■7 1 s'7 p ^*jv^TffilE^^fcy— ;* • -f p<— i?&Jrm~ 

:/ • 7*-?? h<nmfeist\tLy—x • -ry — ~J<n 
m-griz , ^MtE * tilt-4 * — 'J & <$<ttfrb$m §^t-> 

[iS*99] 8»#«8|E«^:#jfcK:j8V'>-t\ 50 
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2 . 

— h • 7*-7y h^ffllE^^fcy— X • W* — ^©|§ 

^rtrojttestifcy— x • j *—i?&ft : m-tz,-.v L 

[1***1 1] »**7lE<ft«)*jfeK:i8V^, 

a-ifcy— * "( ^^Ko^a-efEtg-r 

3H«tt«)**o|tS:»oaWEy-^ . w>-a?Sr, t> L 

Mi^Ztitcy—x ^e^V^ • ^ — v^fc: 

[11*914] l»*5lilS«l»*ife»r*sv^, KrlE* 

[§i**il5] &8c<E>y—;x • ^—^Srfflv^ri: 

5fcSbf£i-5*if^*£jE£y:7 h ^^TSr^ff-f-'S = 

Sri^oy— ^ • ^SrSlRi^ 
S^^ixfcfltffEy-^ • y( v^Sr, AtjfS^-^V ^ • 

[it**i 6] n**i siBfjo»iiifc*5v^r, auie 
; ef-Y^4^y7h'?x7i4, m&* 4 >i> i m$,*Wi* <d 

ley— ^ • I'^-^co^w^t'^b, 

«, «lt«JB§ltt©flt«r^l-*-5fcft#«©y— ^ • W 
IiS*9l 7] gt*9l 6fiSttW»B«-*iV''-C, ttjfS 



( 3 

3 

»4#1J-7'3WcSfc?> lowt^t^SrttS, 3£B„ 

inxmi 9] is^iii 5iE®w^a^*3v^-c, nam 

3fc» 3SJFl£;ft/t#tigJRy-;x y-^Sr^^Pj^ 
gct'-r^fite, ayf a - • !7— ? *=r~- z/ 3 

XSriS-f-r.tteJ:5^SixS, ^B 0 20 
[Ht*« 2 2 ] M*g| 2 1 flEttOKItfc&V 9 V 

<£>4§-g- i- , rate $ nfc wih-y p< — v'tt * ^ e> gj® 
5, mm, 

in** 2 3 ] 2 2 iE«cw^a^*jv >r, #— 
v rate $ tifcsafs-r * — *si± <p.t- <t t> ±fr hm 

t)*^>4x5, SB. 

[if 2 4 ] RftS 2 1 ISttO&Bfc&V ^"C> ftftffi 
£tifz.1ftmy~-x • -i"^— ^lir- 30 
ft*, 3£«o 

[if*^2 6 ] ffi*m2 OIBfcWlSBfcSSV^ MIB 
*-»F>f^ --T^ — -^Srli*1-Sfcit)Wy7 hpx-T&G 

[sf*«2 7] I»#*2 6E*W>3itfifc:*SV^C, IMfc 

trSB. 40 

2 8 ] ff#^ l 5 |Btt£>ttfB£:|3 V SiH 
W»«tt<B**<0fl*ttofflnEy--.* • -f*-s?a», <b 

ass, 

[§f#«2 9] |f*^l 5lB«0««te*JV^T» 

< t t> lOOy-^ • t — iftf^r-FJ ? • ^ ^ — 
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4 

[fl*« 3 0 ] if 1 5 G&O&ltfc&V ^t, ItriE 

■9-yyh • ■<**- >j <D^ft%.$>tz.n ft 

fti, SB. 
[0 0 0 1 J 

[0 0 0 2] 
[0 0 0 3] 

y— ^ "fy-yw-^ h «>r*— s?ro##f$ttfc 

-f /H»»KE«Snfc-tn-P*l05*Ate— ffe-fS y-x 

^JSJ:^ (RGB) WgjfespjaaSMw^tt 
(Root-Mean-Square (RMS) error) <D/<— 'J g ^Srff^t 

[0004] f-^«*^«ffc J: 9 *lf>f ^ • ^ > -V\z 
tl. *«ajt?l4, RGBORMSX7- (RMS error) ft 

^^fcRGBWRMsxy-^ni^nt, y— ^•-r 

^5. S'hiOMRGB RMSX7- Sr^foSrJU ^Xh 



5 

5« SUtf>JSJ6<Z>7giiBlt giJ<7)4i0f»-*3V^"C{S:V^9-Sr 

[0 0 0 5] 10 
[^^O^S«] Hilt ^-^yh^^^l 

* yv— m x y— ^ • ^< — v> L-OB^e>jh,5tfrjt 

^S/^frfr 5 fcA^flH^bftSo y— 7 

'— ifx • yv~ i 8 t>*fc, y— ^-^y— 
if-r ^*^j&s#3S-e#>£> 0 u—f-'^v * y i* 

iBR^J: 9i«< , ^ou-if . ^ 7? frh'i%hft%>1fr 

— y. iri 6 £ iF-r^y • :7V— ir 1 8^ 
fey— ^ ->f S^l 2S:MlE-t-*fc*. b^*-A:*JSr 30 
^h°rL — ^ . 17 — y^7^ — v-g y2 o^/Bi^;fi 
^^t°^ — ^ * !7 — y*7^— y2 Ofi^Tc, A 
It^^-y^ h • -fy— ^1 4SrgJtftO % ^eihV 

T^i9^Six5*1?>f ^ • -T^-^l OI3:y-r/U2 
2<z>7V^ #y^f/U2 2^sy— ^ * >f 

y—^1 2tfc^ • -f y— 0<7)^1^ 

^^^■h^gy^ (Adobe Photoshop) (SftjffijK) 

yv'a (Sfift^) , PC^tttUNIX i&»m&) 

< ± 5 y tfa-* 2 4 Sr, ^eif 

>f ^ *>f *-i?2 2*|B*i-3fc*fcffl^5££as-C# 

K^y >^tHA8f2 8 S:/Hv*Sr *aST?S5. 

[0006] fflffi^nfcy-^ . -fy— y 1 2 it 5J*r 

Six, !7 — ^;*^~> 3 ^2 o^Jt^sns-r— 50 
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6 

*3 oirfstS^txsr ktf^mxhZo ±<om$Lvtzy 
• 2Sr^*rUrc*L**fe«ffcfty— ^ • 

^ ^ ^ v^^r^^c-f"^) fc#>lC, add images t 

o d a t a b a s e W y — y^<— * 

*0) ^n^^A^ffl^fetbSo i&BMflfclt add_ 
ima g e s t o da t a ba s &7 & 7 

7t4 /\si/77 L j±<D7* v u^hyooy^h^, >f 
TJt^^ttTt*^^ h y %m^^xy—7 

« (square) ^ffl^ftttldi »9 *tS»jff^»tt* 
tb^o — *lfi?g»^*5V>T(i:, y— ^ * ^^-i^^^V 

.^^^^^M^^)5fe^ 0 y— ^ 

• v^^tK— h W' — h • 7st—Ty ht?fc«4fe 

#J«i-r.fcj£<. A^ffio^p^y— ^ • i/co%m 

tt, ±J@^^-fXtcJ:(?^ffl$n^^^ hy fc:^^ 
— hft$Hfc-f ^Srfi^ti^T^^ • ^7"r 
J*XhZ, Q 

[0007] g|2ii % f^^3 0 (Hi) rtoy 
-^•^^-^12 6011^5:^0 y-^-^^-v^l 
2 tt. mm^— h - /- K3 2, A/i— h • /— K3 
4 , »3f/U— h • y — K 3 6 <o£o£/u— h • y — K (to 
ot node) <DTfc5»SS*XTE«$Jh,5o Stt^y- ^ 

tt, tdfe/u— h • y — k 3 2 t^f^i ? - y7 b V^-t 
^StUTSWSJxSo h • y— K3 2<7>T»r*> 

• y r-r^Sr^-tfy-y-r ^ h y x&% 0 *v v~r;v 

• f-y-r-f \s# V V 3 8il x y/u-y--rxr-co#y— ^ . 

— v^4 0<^«J5Blfen"CV^*V^— i/Sr^tfo 
a dd ima ge s to da t a ba s e7 P n^' 

9^6 (O^^S: it An fen^e v ^^ir ft -=eif >r y 
5fej*t^y— ^ • y— ^sstfejoffibns^-e, 
y ^-jvu • -y-^^ h y 3 8 ^j»«psns. 256 

X 2 5 6 4 2*5<fcU*6 4 X 6 4 (t°yir 

^) 4 4 7?*Jil5T^ U-y h y It 7^~"^yh-ft* 

It *j»6S4tTy h . ^y^Srta^-rsfcft^t LT 
ffiv^ftio *M»-*3V^T»t 3 2X 3 2 (t°yiryu) 

4 6<^^-< uy hy it iH7 p Dt^«:^^ y->- 
K^f-f^ •-ry-v ; ^M,5fc*!)ir^ffl$:n^y-^ 

• -ry — i^Sr^tPo 16X16 (tfyir/u) 48, 8X 
8 (tfy^yu) 5 0, *5J;IMX1 (t^y-fe/U) 520 

v-?*f<t \o$ h y it ^tv^ • y7f !>x7^iK' 



7 

jtsfiawrK^UD— k (preload) sn^y^^ 

>*Sr&tro 16X16 (tf^ir/u) ,8X8 
i?/u) $$£Xf 1 x i (tr^iryu) cq^^t^ h JJ 

(^-£;b-tf:S, matching) fcfttfflV^nSo ffi 

[0 0 0 8] H3tt, ^ef-V^ •Y^—^i^tSfc 
ft<a*ffiSr*1- 0 02, El3*5J:Wia4Sr#flgi-5 0 * 10 

struct an_ image { 
. char *path; 
char used; 

* / 

unsigned short *r; 

unsigned ahort *g; 
unsigned short *b; 
struct an_image *next 

> 9 I 

struct an_image ^previous; 

} an — image; 
[0010] M*-fi, ^ * ^ — S^:*SttS#* 

-f /M* 8 X«l^y®*X 8 Ytt*^««^tpft fetf, 
8X8 (fc°^i?/w) ^y^7^^^f)P- K 

v*Z>1NfX{i, $$%&£>l£ (matching) Xnir^pp 

vHfcfc«L<, apt>,.#«ifc»oT^««S*:0 1 t: 0 

[0 0 11] ^efV^ •/Ui/yAft y^-^.^^^. 

r x j x r yJ ^>f/u2 2t^fj**L-s« 
(x, y) tt, J^T^J: 5 trfo^o 

[0012] (target_image_width / width__subsample 
s, target_image_height / height_subsamples) ((9 

[0 0 13] XTy^G 8^£;ft,5 £ 9 C\ mtz.*£# 
»TfcW««6 6*n-KSil5o o— 
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•-f JBSStifc'?*— *^<— * J: 9* 

y h • >f U • -Y ^ ~-Z?<D&9'( 

-So 

[0 0 0 9] 

[*1] 

/ -r y - £ tifc^i* 5 

/ RM S^#£*?*i*Z>rt:i&<D RG B ^ 



/ #c <d m M *v <o # -f 

fc^^««J-*tliS-f5y— ^ ->f^— * t^tyu/iip 

[0 0 1 4] ^^ibit^nir^h*, ^^^2 2Sr5/y 

»r*5*tS#^-Y/W2 21-o^T. *^^ffi*6 6(0^ 
»*5<tV# (RGB) O^^^/K^sp^jft-^sp^jftH 

(average Root-Mean Square (RMS) error) 0^®j(4, 
iS«I**¥lfe*-Cfc9^o rffiffi (used) J 
V^-^-<-^l-^5(t^^y-^ • ^ vt^^tLT, 

«hcofficoRMS^T— tt, RGB^^^HrSLTW-JS 

^fiESOfeWc (running sum) £ LTft)f^n5o 

*^/H^#ft-t-*ft5>tf, ^I^f7^7 0^§ o 

fc^feli, a.fiO^ff*C0RGB RMSx 7 -/)\ 
f^7 8 ± 5 t-^ y — ^ • ^t^^/U 
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9 

[0015] y— 7 • -f^-^^^T^^-f /uosfleitt 

S^9 — ^oy- 7 • -< v^N 9—>fyY*<i* 
— ?J\^tetf%#^M^1&-?Z>*y £ <<<? • y —v?fc*3 

*U gfttt^77^^7 O^MSo ^T5//8 2^V^ 

ff<D^7— £:f?roy— 7 . y — v^s x 
( ) y-7 • p< — ^i± v y-7 . >f y - v^s^u-V y . ^ 

[0 0 16] 9—>?y V "4 *~-Z?\ZtS\1'Z>&#'fMZ 20 
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y— 7 • -fy— M>7*7 h • 7r>f/H: 

£ 5 ^ #^>fyWr*tbT<7?ft/h<D-&tf<o^5^-oy — 

v * v >f s fc « r t * s n fc * e> « . 

gfttl^77^/6 8^<M£o 
[0 0 17] RMS^y— COff^^^tf^#-^^ityo 

i-^o/d i o<7M y - ^A^iBHrtJdte* b*v^t?, 

3o<7)« («2, 3t3. «4) fc5MWLfc 0 ) 
[0 0 18] 
[*2] 



) 
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y-^ogfr */ 

int f incLmatches (int x, int y) 

register i, rt, gt, bt; 

int low, result, ii, the tile; 

char imagename [2 56] , best_path [256] ; 

unsigned short rmas [XMAX*YMAXj , gmas [XMAX*YMAX] , bmas 
[XMAX*YMAX] ; 

the„tile = x+(y*sizex) ; • 

/* b • *f * - ^Ol <DWt^G> if x ) v KffiBtCtf LT, ,x 

Sfi^v - K */ 
/* 3*1 So */ 

ford = 0; i < pixels; i++) { 

tiles [the_tile] .listti] .score=99999999; 
tiles [the_tile] .list [i] .rank = O; 

} 

etrcpy (imagename, filename) ; /* ^ - ^ v h ♦ ^ — <D 

imagename [etrlen ( imagenaroe ) -3] = ' s ' ; /* ^:4x^^ffl^C^7 t -Y /I^S^l 

imagename [strlen ( imagename ) -2 ] = ' g' ; 

imagenaroe (strlen { imagename) - 1] *= ' i 4 



* - 



get_grid_3pace (rmas, gmaa, bmas, x f y) ; /* & — f y \* 4 ^ — i? CD 

mmcom&^ti-tZ'i * - ? */ 
*/. 

image = head_image; */ v — X -Y ^ <0 *) > ^ * il 'J X 

while (image- > next ! = NULL) { /* §V -X-T ^ - 5?*cSLT^^ 
result =0; 

/* d tilt RGB RMSx7-0/<»Jx-^ 3 >t$5 o ©S^B^-fb 

-tZfztb icj&Sfcran^s */ 

[0 0 19] 40 [3c3] 
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13 14 
for(i ~ 0; i > size; i++) { 

rt = (int) ( (unsigned char) rmas [i] - (unsigned 
char) image- >r [i] ) ; 

gt = (int) { (unsigned char)gmas[i] (unsigned char) 
image- >g[i] ; 

bt = (int) ( (unsigned char)bmas[i] - (unsigned 

char) image- >b [i) ; 

result += (rt*rt+gt*gt+bt*bt) ; 

1=0; 

— ^ SJf ^ */ 

if (result < tiles [the_tile] -list [pixels- 1] . score) { 

while ( (result > tiles [the_tile] .list [i] * score) 
&&(i++ < pixels) ) ; 

for ( ii = pixels-1; ii> i; ii--) { 

tiles [the tile] . list [ii) . score = tiles (the 

tile] . list [ii-1] . score; 

tiles [the tile] . list [ii] , rank = tiles (the 

tile] - list [ii-1] . rank; 

tiles [the_tilej .list (ii] .pointer - tiles (the 
tile] .list] ii-1] .pointer; 



tiles [ttie_tile] - list [i] . score = result ; 

tiles [the_tilej .list [il .rank - i; 

tiles [the_tile] , list [i] .pointer = image; 



image = i mage - > next ; 

} /* wh i I e (&*7<<Ad */ 

/* 9 x b #;<o h tcD^vi v ~ b ^ a>u^ &&ja> y 

low = tiles [the_tile] . list [0] . scorer- 
tiles [the_tile] .score = tiles (the_tiiej .list [0] .score; 
tiles [the^tile] .rank « tiles [the_tile] . list [01 .rank; 
strcpy(best_path, tiles [the_t ilej .list [0] .pointer- >path) ; 

Sre^ir^d7 fcile] * reqUired " fcile3 [the_tile] -list[0] . pointer- 

[0 0 2 0] 40 [3t4] 

strcpy (tiles (the_tile) .path, best_path) ; 

sprintE (imagenarae r w %s/%s° , disp_version, best_path) ; 

/* y^x^y--/^V-^^^^^5p*/ 
return low; 

} /* find_matches () */ 

(0 0 2 1 ] &$£W<D— MMMM\Z^^xm2<Dju— flx 9 til U ^o, §y-^ • >f ^ -^i l BWftfflS 
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jftftV^ir&W^So (r^n^-Mi, ^V^>- [0 0 2 2] 

/* ^p/7A (findjnatches 0) 0S107x-XC*V^ * — 

int optimize (> 

int i, x, deepest = o, change, a, step, which; 

/* ctLHN A 2r;WJX^*5, tt:-*~c. ^;^©©*y* M£ 

for (a = 0; a < pixels? a++) { 
change = 0 ; 

for(x = 0; x < pixele; x++) { 
which =0; 
do { 

step =0; 

for(i = 0; i < pixels; i++> { 

KlL^ +/ 

/* "C?T9o ctita^y-fc-t 
**i£*~y*r*ei<h#Tr#£o rste p(Xt" v*7)J ttOlc&f < 
t) s */ 

. /* d o -wh i le ( K * — 

if ( (tiles [i] . rank <~ 
which) && ( istrcmp (tiles [xj .list [which] . pointer- >patch, 
tiles [i] .path) ) ) { 

100 2 3] [*6] 



( 10 ) 0-269353 

17 18 

^ ^ /* 5>2 (rank)*<H iSTr&n 

fcf^ X ztT (score) ^t^jc-/ ^^5o */ 

. if ( (tiles [i] .rank 

which) && (tales £±J .score > tiles [x] .list [which] .score) ) 



continue 



} while {step) / 



if (i == x) continue; 

which++,- 

step = 1, 

i - pixels; /* wh i 1 e 

} 



if (which > deepest) deepest = which; 
/* *1SW 

.*_ff (strcitp (tiles M ,path # tiles [x] . list [which] . pointer- 
>path)) { * 

change ++ ; 

st rcpy [tiles [x] - path, tiles [x} .list [which] . pointer - 
>path) ; 

>requ"e3r ^ required = tiles "'.list [whichj .pointer- 
tiles Jx] .score - tiles [x] .list [which] .score; 
tiles [x] . rank = which; 

} /* for (7*--) */ 

fcotLr^'^ K fi*«LTjK, JW©tt«K*ivcj: a 

B-Oo */ 

if { ! change } break ? 

«?^^ f n (Std ^ rr ' "^ n%d / %d < * d changes (deepest is %d) \n» a 
pixels -1, change, deepest); ' w » a ' 

(for)^T^LTiS^^5„ */ } f or(7 4— ) */ 
} /* optimize () */ 

[0024] &#^fe*:/n-tr*tettVvr*1fV* • -Y hi-fi - t 5„ yUA|B«*i±tJ«*HPn«ISrffl 

K£tv1Z*'f/i'<o!) * h&S^HJU v*— K*5 o-AXIi^^f-( 7*Jcwfi £ s il^cofp 

*b*V\, fcTy h • ■?-y7 , \-i*r~?-l l zm^£fr «t»W]»|7*y V<m, (solid color) 



[0 0 2 5] <fV9A"*:V>(9 --Y^-S^tt, aK, 5o «oT, 7*y V Htt^Jtfc b< A*.fc:<V*. ^n-fc 
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19 

T-zit#>\zm^btiz>&mTt$>9 * ants? ft 

[00 2 6] y-* . >f > -^3BRw*^««Sra^ 
? • s^i o 2, H2£>^i>-v^ • >r^— yi o 4 

-^1 0 8 t*5«t*^>f/K *5j;rM*-^i 1 0 43 J: 

¥^Sr^^i-o >f S*l 0 8*3±tM 0 2Sr£C5*§ 

v\ >f^^n 0*s,fciM o 4«r£C5*S*i:fc5# 
2^##ffc*5V^-C. * ^ ^gfc 5 4 x 4 t 

[0 0 2 7] *f v*l 1 2*5 ±1*1 O 6&$iVZ>1£$k 
V^btlSo 16X16t^«m WW^^ll 

2IW-yy h - >f* — £?i o o^HKWl-iav\ JE 

^-T^o ro±5 4**^»tt(Oft& (—ft) IS, 

[0 0 2 8] Bfc^StLfcy— * • * — v^M^Oti^ 
teiBi-c, f^WKSrttffl U KJI&tV^-^ (high 
-frequency detail) vggJ$t->tf LTffiV u V h 

*l5o IW^tfW^-^10 6OT*^8 40 

[0 0 2 9] EI 6 IS, * • -f > — ^w^flctastt 

^•^^^114 £»2<*>=eif-<r ^ • 4 1 6 

tt, 9—#v h^^^ll 8*»fe^S*t*: 0 ffil 
co^e^V^ ->T^— V s ! l 4H, y^.>f^-i;iR 
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7 P n-fer^<^Ht-%^$tlfc#^^/Urt<0 2 X 

I6xi 6 J: 94j«S}ifco *i 

y-* ->f ^-^WJD**9dS«v^?>nfco i^WK 
^##ftf> »l*3Atf»2^f-f^ •-f^-v* 

1 6«\ mico^if^^ --f^-^1 14i9t)*-y 

y h -^y-v^i i 8 t(ommm^\^\ t£ox, 
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1. Title of Invention 

Digital Composition of a ilosaic Image 

2 . Claims 

1. A method for generating a mosaic image with an 
appearance that approximates a target image by utilizing a 
plurality of source images and a computer, comprising the 
steps of: 

loading the target image into the computer; 
dividing the target image into a plurality of tile 
regions, each tile region representing a distinct locus of 
the target image, and 

for each tile region: 

comparing source images to the tile region to 
) produce a measurement of visual similarity, said comparing 

Step including analyzing a plurality of individual portions 
of each source image; 

selecting the source image with the highest 
measurement of visual similarity to represent the tile 
region; and 

positioning the selected source image in the 
mosaic image at a locus corresponding to the locus of the 
tile region. 

2 . The method of claim 1 including the further step of 
dividing the tile region into distinct sub- regions, each sub- 
region corresponding to a specific portion of the source 
image, and' comparing each respective sub-region with each 
respective source image portion to produce the measurement 
of visual similarity. 

) 

3 . The method of claim 2 including the further step of 
employing source images having one pixel per respective sub- 
region . 

4 . The method of claim 1 wherein said comparing step 
includes the further step of computing the average Root -Mean 
Square error of Red, Green and Blue channels. 
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5. The method of claim 1 including the further step of 
removing aource images selected in said selecting step from 
consideration such that no one source image appears more than 
once in the mosaic image . 

6. The method of claim 1 including the further step of 
capturing source images, and storing the captured source 
images in a database. 

7. The method of claim € including the further step of 
generating modified source images by cropping the source 
images captured in said capturing step to square. 

8. The method of claim 7 including the further step of, in 
the case of a captured source image in landscape format , 
cropping the captured image from center . 

9- The method of claim 6 including the further step of, in 
the case of a captured source image in portrait format, 
cropping the captured image from above center. 

10. The method of claim 7 including the further step of 
categorizing the captured source images within the database. 

11 . The method of claim 7 including the further step of 
storing the captured source images at different levels of 
resolution. 

12 . The method of claim 1 including ' the further step of 
deselecting the source image with the highest measurement of 
visual similarity if it is determined that the source image 
has a higher measurement of visual similarity to another tile 
region. 

13* The method of claim 1 including the further step of 
specifying at least one source image for assured inclusion 
in the mosaic image, the assured source image being 
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positioned in the mosaic image at a locus corresponding to 
the locus of the tile region having the highest measure of 
visual similarity therewith* 

14 - The piethod of claim 1 including the further step of 
specifying a sub-category of source images for exclusive 
matching with a predetermined portion of the target image. 

15. An apparatus for generating a mosaic image with an 
appearance that approximates a target image by utilizing a 
plurality of source images, comprising: 

A computer workstation that executes mosaic generation 
software being operative to divide the target image into a 
plurality of tile regions, each tile region representing a 
distinct locus of the target image, 
} said mosaic generation software being further operative 

to operate upon each tile region to: 

compare a plurality of source image portions 
to the tile region to produce a measurement of visual 
similarity; 

select the source image with the highest 
measurement of visual similarity to represent the tile 
region; and 

position the selected source image in the 
mosaic image at a locus corresponding to the locus of the 
tile region. 

16 . The apparatus of claim 15 wherein the mosaic generation 
software is further operative to divide the tile region into 
distinct sub-regions, each sub-region corresponding to a 

' specific portion of the source image, each respective sub- 

region being compared with each respective source image 
portion to produce the measurement of visual similarity. 

17. The apparatus of claim 16 wherein the source image 
employed for comparison with the tile region has one pixel 
per respective sub-region. 
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18. The apparatus of claim 15 wherein the mosaic generation 
software is further operative to compute the average Root- 
Mean Square error of Red, Green and Blue channels. 

19. The apparatus of claim 15 wherein the mosaic generation 
software is further operative to remove selected source 
images selected from consideration such that no one source 
image appears more than once in the mosaic image. 

20. The apparatus of claim IS further including video 
equipment selected from the group consisting of a video tape 
player and a videodisc player, said video equipment being 
operative to capture source images for storage in a database 
in the computer workstation. 

21. The apparatus of claim 20 wherein modified source images 
are generated by cropping and resizing the captured source 
images to a consistent size. 

22. The apparatus of claim 21 wherein, in the case of a 
captured source image in landscape format, the captured image 
is cropped from center. 

23. The apparatus of claim 22 wherein, in the case of a 
captured source image in portrait format, the captured image 
is cropped from above center. 

24. The apparatus of claim' 21 wherein the captured source 
images are categorized within the database. 

25. The apparatus of claim 21 wherein the captured source 
images are stored at different levels of resolution. 

26. The apparatus of claim 20 further including an editing 
computer with software for editing the mosaic image. 
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27. The apparatus of claim 26 further including a printer 
for printing the edited mosaic image. 

28. The apparatus of claim 15 wherein the source image with 
the highest measurement of visual similarity is deselected 
if it is determined that the source image has a higher 
measurement of visual similarity to another tile region. 

29. The apparatus of claim 15 wherein at least one source 
image is assured inclusion in the mosaic image, the assured 
source image being positioned in the mosaic image at a locus 
corresponding to the locus of the tile region having the 
highest measure of visual similarity therewith. 

30. The apparatus of claim 15 wherein a sub-category of 
t ) source images is specified for exclusive matching with a 

predetermined portion of the target image. 

3. Detailed Description of Invention 

Field of invention: 

The present invention is generally related to 

computerized manipulation of images, and more particularly 

to generation of an image from a plurality of sub- images. 
Prior arts: t 3 

Analysis and manipulation of images using computers is 

well known. For example, computers have been used to analyze 

images of coins travelling along a conveyor belt to 

distinguish different types of coins and compute the total 

value of the coins, similarly, computers have been used to 

' ) analyze images of integrated circuits and printed circuit 

boards in order to detect defects during manufacturing. 

Manipulation of photographic still images and full motion 

video images to produce special effects is also well known. 

However, these known techniques do not produce artistically 

pleasing mosaic images. 
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Means to solve problems: 

In accordance with the present invention, a mosaic image 
that approximates a target image is produced from a database 
of source images by analyzing tile portions of the target 
image, comparing each respective analyzed tile portion of the 
target image with the source images from the database to 
provide a best -fit match in accordance with predetermined 
criteria, and generating a mosaic image comprising the 
respective best -fit match source images positioned at 
respective tile portions of the mosaic image which correspond 
to the respective analyzed tile portions of the target image. 
In one embodiment the criteria for the best- fit match 
includes computing a version of Red, Green and Blue ("RGB") 
Root -Mean Square ("RMS") error. Other matching systems could 
be employed as long as the goal of finding the source image 
i. ) that is most visually similar to the region of the target 

image under consideration is met. 

Increased resolution is realized in the mosaic image 
through sub-region analysis. In particular, each tile 
portion in the target image is divided into sub-regions which 
are independently compared with corresponding sub -regions of 
each source image using, in this example,, RGB EMS error 
analysis. The computed RGB RMS error for each sub -region is 
Hummed to provide a sum RGB RMS error for the entire source 
image. The unallocated image having the lowest sura RGB RMS 
error is then allocated for use in the corresponding tile 
portion in the mosaic image. The use of sub-regions even 
benefits regions without detail and results in more uniform 
distribution of color by selecting lower contrast images for 
these areas of little high-frequency detail. Another 
) embodiment employs a second pass to prevent a source image 

from being placed in a given location in the mosaic if it 
would have a lower error in another location. 
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Embodiment: 

Fig. 1 illustrates apparatus for generating a mosaic 
image 10 from captured source images 12 to approximate a 
target image 14 • In the disclosed embodiment a VHS video 
tape player 16 is employed to facilitate capture of source 
images from video tapes. The video tape player may be 
employed to single-step through a video tape to capture still 
images for use as source images. Alternatively, source 
images can be captured in real-time during playback of a 
video tape. A computer controllable laserdisc player 18 also 
can be employed to facilitate capture of source images. 
Laserdiscs are preferable to video tapes when the desired 
subject matter ie available from both sources because of the 
higher quality and easy random access to still images 
available from laserdisc. In the disclosed embodiment a 
computer workstation 2 0 with a video input is employed to 
capture the source images 12 from the video tape player 16 
and laserdisc player 18. The computer workstation also 
accepts the target image 14 as input, and is employed to 
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generate the mosaic image 10 from the target image and source 
images by executing mosaic software. The mosaic image 10 
generated by the mosaic software comprises an array of tiles 
22, where each tile 22 is a source image 12, and the overall 
appearance of the mosaic image 10 approximates the appearance 
of the target image 14- An editing computer 24 such as a 
Macintosh (TM) , PC or UNIX (TM) based system equipped with 
image editing software such as Adobe Photoshop (TM) can be 
employed for editing the mosaic image 22, to produce an 
edited mosaic image 26. A printer output device 28 may be 
employed to print the edited mosaic image 26. 

Captured source images 12 can be analyzed and stored in 
a database 30 that is maintained in the workstation 20. An 
add_images_to_database program is employed to analyze raw 
captured source images 12 and create new source images 
1. ^ therefrom. More particularly, the add_itnages_to_dat abase 

program accepts a list of filesystem directories, an image 
size, and an output path as input, and operates in response 
to open each designated directory and search for source 
images from which to crop and resize to the specified 
dimensions. The square is subsequently moved to the location 
specified by the output path. In one embodiment, if the 
source image is in landscape format, a square image is 
cropped from the center of the source image. If the source 
image iB in portrait format, a square is cropped from between 
the center and the top of the source image. As a 
consequence, the square image is more likely to include the 
emphasized feature of the source image, such as a person's 
face, without clipping the edges thereof. The images are 
then stored in the database 30. The database 30 is a file 
) system which holds the formatted images in directories that 

are categorized by subject matter and size. 

Fig. 2 illustrates organization of source images 12 
within the database 3 0 (Fig. 1) . Source images 12 are 
categorized and placed under root nodes such as an animals 
root node 32, a people root node 34 or a places root node 36. 
To generate a mosaic image from source images of animals, the 
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animals root node 32 is selected for the mosaic software. 
Directly under the animals root node are subdirectories 
containing identical image files at different levels of 
resolution. An originals subdirectory 38 contains uncropped 
versions of each source image file at full size 40. The 
originals subdirectory 38 is maintained because source images 
may be recropped during mosaic creation if the results from 
the add_images_to_dat abase program are unacceptable. 
Directories labeled 256 x 256 (pixels) 42 and 64 x 64 
(pixels) 44 contain large versions of the formatted source 
images which are used primarily for output ting a final 
bitmap. In this example, a 32 x 32 (pixels) 46 directory 
contains source images which are used for viewing the mosaic 
image on the screen during the construction process. The 16 
x 16 (pixels) 48, 8x8 (pixels) 50 r and 1x1 (pixels) 52 
subdirectories contain source images which are preloaded when 
the mosaic software is initialized. The source images in the 
16 x 16, 8x8, and lxl subdirectories are employed for 
matching source images to target image during mosaic image 
generation- Directories of source images at other levels of 
resolution may also be maintained. 

Fig. 3 illustrates a method for generating the mosaic 
image. Referring now to Figs. 2, 3 and 4, the target image 
1b selected and loaded as indicated- in step 60. A root node 
of source images in the database is then selected and loaded 
as indicated in step 62- More particularly, a database path 
is specified and a mosaic program is executed. The mosaic 
program reads source images from the section of the database 
indicated by the specified database path, analyzes the target 
image and selects a source image for use in each tile of the 
mosaic image. More particularly, source images having 
resolution corresponding to the selected number of sub- 
regione ("sub-region resolution") for the mosaic image are 
loaded into a linked list of structures: 



struct an_iniage { 
char *path; 



/pathname of file in da t abase/ 
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char used; /whether image has been 

used/ 

unsigned short *r; /RGB image data for RMS 

matching/ 

unsigned short *g; 
unsigned short *b; 

struct an image *next; /pointer to next 

structure/ 

struct an_image *previous ; /pointer to prev structure/ 
} an_image; 

For example, if each tile in the mosaic image is to contain 
8 X-axis sub- regions by 8 Y-axis sub-regions, then 8X8 
(pixels) images are loaded from the database. The size of 
the target image in pixels along each axis is equal to the 
number of output tiles multiplied by the number of desired 
sub-regions to be considered during the matching process, 
i.e., one pixel per sub-region along each respective axis. 
The respective numbers of tiles which will be employed for 
the X and v axes of both the mosaic image and target image 
is then specified as indicated in step 64. 

The mosaic program executes a matching process once the 
source and target images have been loaded. When the matching 
process begins, the target image is divided into "x" by M y° 
tiles 22, where (x, y) is: 

(target_image__width / width_eubsamples , target_image_height 
/ height^subsamples) 

A new tile is loaded as indicated in step 68. A new sub- 
region 66 is then loaded as indicated in step 70. Loading 
begins with the upper left sab-region 66 of the tile 22, and 
moves from left to right through each row, and from top to 
bottom by row. The source image pixel that corresponds to 
the loaded sub-region is then loaded as indicated in step 72. 

The matching process analyzes tiles 22 individually on 
a serial basis. For each tile 22 in the disclosed 
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embodiment, a variation of the average Root -Mean Square 
("RMS" ) error of the Red, Green, and Blue ("RGB" ) channels 
of each sub-region 66 is compared to each respective 
corresponding source image pixel, for each source image in 
the database that is of proper resolution and is not 
designated as "used. - A RMS error between the loaded pixel 
and loaded sub-region is computed for RGB channels and kept 
as a running sum for the tile as indicated in step 74. if 
unanalyzed sub-regions exist in the tile as indicated in step 
76, flow returns to step 70. If all sub-regions have been 
analyzed, as determined in step 76, then the running sum RGB 
RMS error is compared to the lowest such error yet computed 
for a source image and the tile as indicated in step 78. If 
the error sum is lower than any previously recorded error sum 
f f ° r the tile ' the error sum value and an index to the source 

w image are recorded as indicated in step 80 . 

When all of the source images have been analyzed for 
similarity to the tile, the source image with the least 
computed RGB Rms error is assigned to a tile in the mosaic 
image corresponding to the tile in the target image, i.e., 
in the same location in the image. More particularly, if 
other source images in the database have not been compared 
with the tile as determined in step 82. a new source image 
is loaded as indicated in step 84 and flow returns to step 
70. if all source images have been compared with the tile 
as determined in step 82, the source image with the lowest 
sun, error is allocated to the tile and marked as -used" as 
indicated in step 86. The assigned source image is marked 
as "used- so that source images do not appear more than once 
in the mosaic image . 
1 . ) The matching process is repeated for each and every tile 

in the target image. Upon completion, a li 8t of source 
images i B written to a text file which is used by a final 
rendering program to construct a bitmap from the full 
resolution versions of the source images. More particularly, 
if all tiles have been examined as determined in step 88, a 
list of the lowest sum error source images for each tile is 



( 30 ) 



♦SBflspl 0-269353 



written to a text file as indicated in step 90 , and the 
mosaic program reads the list and assembles a bitmap as 
indicated in step 92. If unexamined tiles still exist as 
determined in step 88, flow returns to step 68. 

A variation of the matching process, including 
computation of RMS error, is implemented aB follows: 

/* The goal of this routine is to find which source 
photographs are the most */ 

/* visually similar to a given region (grid-space) of the 
target image . */ 

int f ind^tnatches (int x, int y) 

register i, rt, gt, bt; 

int low, result, ii, the tile; 

char imagename [256] , best_path [256] ; 

unsigned short rmas (XMAX*YMAX] r gmas [XMAX*YMAX] , brnas 
[XMAX*YMAX] ; 

the_tile - x+(y*sizex); 

/* For this given grid- location of the target image, 
clear the list of errors. */ 

/* ThiB list will later contain the computed errors and 
will be sorted from best */ 
/* to worst */ 

ford = 0; i < pixels; i++) { 

tiles [the_ti lei .list[i] .score-99999999 ; 
tiles [the_tile] .list[i] .rank = 0? 

} 

strcpy (imagename, filename) ; /* Get the name of the 
target image */ 

imagename [strlen( imagename) -3] = * s' ; /* Make sure that it 
has the proper filename extension */ 
imagename [strlen (imagename) -2 J - 'g'; 

imagename [strlen (imagename) -1] « ' i ' ; 

get_grid_space (rmas p gmas, brnas, x, y) ; /* Get the image data 
for the desired region of the */ 

/* target image and put it into three arrays. 

*/ 

image = head_image; */ Reset the linked-list of source 

images to the beginning */ 

while (image- > next != NULL) { /* For every source image we 
are considering */ 

result « 0; 
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/* This is a variation of RGB RMS error. The final square- 
root has been eliminated to */ 

/* speed up the process. We can do this because we only care 
about relative error. */ 

/* HSV RMS error or other matching systems could be used 
here, as long as the goal of */ 

/* finding source images that are visually similar to the 
portion of the target image */ 
/* under consideration is met . */ 

for(i =0; i > size; i++) { 

rt « (int) ( {unsigned char) rmas [i] - (unsigned 
char) image - >r [i] ) ; 

gt = (int) ( (unsigned char) gmas [i] - (unsigned char) 
image- >g[i] ; 

bt - (int) ( (unsigned char)bmas [i] - (unsigned 

char) image - >b [ i] ; 

result •*-= (rt*rt+gt*gt+bt*bt) ; 

} 

i = 0; 

/* The following code takes the error computed for the 
I ) last source image and inserts */ 

/* it into a sorted list of all of the source images* 
The list is shifted towards the */ 

/* end to make room for this insertion */ 

if (result < tiles [the_tile] . list [pixels-l] • score) { 

while ( (result > tiles [the_tile] .list[i] .score) 
&&(i++ < pixels)); 

for(ii « pixels-1; ii> i; ii--) { 

tiles [the tile] .list [ii} .score - tiles [the 

tile] .list[ii-l] , score; 

tiles [the tilel . list [ii] .rank = . tiles [the 

tile] -list [ii-l] .rank; 

tiles [the_tile] .list[ii] .pointer = tiles [the 
tile] .list]ii-l] .pointer; 

tiles [the_tile] .list [i] .score = result; 

tiles [the_tile] .list [i] .rank = i; 

tiles [the_tile] .list [il .pointer = image; 

/* Now let's move to the next source image and repeat 
: ^ until we run out */ 

image * image - >next ; 

} /* while */ 

/* Since the list is sorted from next to worse, we can see 
the best tile by looking at */ 
/* the first list entry. */ 

low = tiles [the_tile] .list [0] .score; 

tiles [the_tile] -score « tiles [the__tile] . list [0] . score; 
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tiles [the_tile] .rank ~ tiles [the_tile) . list[0] ,rank; 

strcpy (best_path, tiles tthe_tile] . list[0] .pointer- >path) ; 

/* Do not let this image get replaced later because it was 
specified as required for the mosaic.*/ 
tiles [the_tile] .required = tiles [the_tile] . list [0] .pointer- 
required; 

strcpy (tiles [the_tile] .path, best_path) ; 

sprint f (imagename, ,, %s/%s ,, / disp_version, best_path) ; 

/* We now have a sorted list of source images from most- 
visually-similar to least-visually-sirailar */ 
/* for this grid location of the target image,*/ 

return low; 

} /* findmatches {) */ 



A second routine is used in one embodiment of the 
i ) invention to take the sorted list from the previous routine 

and not only ensure that each source image is only used once 
but also to see that a given source image will not be 
selected for one region if it is an even lower match in 
another . 

/* In the first phase of the program (f indjmatches ()), 
e created a sorted list of source images */ 

/* for each grid-space of the target image. Since we 
do not want to repeat source images within */ 

/* the mosaic, each grid-space cannot have its first 
choice source image (a source image may have */ 

/* the lowest match for more than one grid location) . 
The purpose of this routine is to decide which */ 

/* of the grid locations actually gets to use the source 
image. For example, it will not be placed */ 

/* in one grid location if it an even better match to 
another */ 

int optimize () 



int i, x, deepest ■ 0, change, a, step, which; 

/* For each of the grid-locations in the target image 
(number of tiles in the final mosaic) */ 

/* This an N x 2 algorithm, so we must loop twice to 
ensure that we consider all images for */ 

/* all grid-locations. */ 

for (a - 0; a < pixels; a++) { 
change = 0 ; 
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/* For each of the grid- locations in the 
target image (number of tiles in the final mosaic) */ 
for(x = 0; x < pixels; x*+) { 

which =0; 

do { 

step = 0; 

for(i « 0; i < pixels; i++) { 

/* If tile is wanted more 

somewhere else, give it to them. */ 

/* We do this by going 
through all the top choices for the other grid locations. */ 

/* If we see the same 
source image listed as the first choice at another grid */ 

/* location, we check to 
see if it is a better match at the other location. */ 

/* If it is, we move 
through our sorted list to the next best match for our 
current */ 

/* grid- location and do 
this until we find a source image that is not a better match 
*/ 

| ) /* anywhere else. When 

we find this, we can keep it. The variable "step* stays as 
0 and */ 

/* we exit the do- while 

loop */ 

if ( (tiles [i] . rank <» 
which) ( lstrcmp (tiles [x] .list [which] . pointer ->patch, 

tiles [i] .path) ) ) { 

/* If rank is same, check 

scores* */ 

if { (tiles [i] .rank 
which) fc& (tiles [ij -score > tiles [x] ♦ list [which] . score) ) 
continue 

if (i -a x) continue ; 

which+*; 

step « 1, 

1 - pixels; /* Skip to 

while. */ 



} while (step) ; 

if (which > deepest) deepest = which; 

/* Now that we found the most visually- similar source 
image that is *not* a better match in another */ 

/* grid location, we se the name of the image as 
associated with this grid-location of the target */ 

/* image. */ 

if (strcmp (tiles [x] .path/ tiles [x] .list [whichj .pointer- 
>path) ) { 

change ++; 

strcpy (tiles tx] .path, tiles [x] .list [which] .pointer- 
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>path) ? 

tiles [x] .required « tiles [x] .list [which] . pointer - 
>required; 

tiles [x] .score = tiles [x] . list [which] , score; 
tiles [x] .rank - which; 

} 

} /* for */ 

/* If we go through all of the grid- locations and we do not 
need to replace any */ 

/* tiles as being a better match in another location, we can 
exit the routine now- */ 
if ( ! change ) break ; 

fprintf (stderr, M \n%d/%d, %d changes (deepest is %d)\n" , a, 
pixels-l, change, deepest); 

/* We need to loop back with this for loop as many times as 
there are grid-space in the final mosaic. */ } /* for */ 

} /* optimize () */ 

A rendering program can be employed to produce the 
mosaic image following the matching process. The rendering 
program reads the list of the selected tiles, locates the 
full sized version of each respective corresponding source 
image in the database, and binds the located source images 
together to create a bitmap. The tiles in the mosaic image 
may be separated by a line to discretize them when viewed 
from close proximity. From a distance, the gridlines should 
be thin enough to disappear completely to the human eye, eo 
as not to interfere with the seamlessness of the mosaic. The 
bitmap is then saved in a standard format to be displayed on 
a monitor or output in printed form. 

The digital mosaic image can be printed in different 
ways, depending on quality, price and size constraints. Film 
recording and photographic printing may be employed. An 
image can be written to photographic film using a film 
recorder- Once the image is on chrome or negative, it can 
be printed on normal photographic paper. This option is best 
for a moderate number of small copies as writing the image 
onto the film is a one time cost. Direct digital printing 
potentially produces the highest quality, but each print is 
expensive. Digital printers employ either continuous -toning 
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or half -toning. Continuous -tone printers deposit an exact 
color for each pixel in the image. Half toning printers 
deposit only drops of solid color, forming shades of color 
by using dots of different sizes or different spacing. 
Hence, the print will look less photographic. Process color 
printing is the technique used to reproduce images in 
magazines and books, and is a good method for producing many 
(e.g., hundreds of thousands) near-photographic copies* 

The effects of sub-region based analysis on source image 
selection are illustrated in Fig. 5- A target image 100 was 
employed to produce first, second and third mosaic images 
102 r 104, 106, respectively. The target image 100 includes 
4X4 tiles. An intermediate "sensed" image representing the 
average of all pixels in the smallest analyzed portion (tiles 
in image 108, and sub-regions in images 110 and 112) . In the 
first analysis, resulting in images 108 and 102, sub-regions 
are not employed. In the second analysis, resulting in 
images 110 and 104, 4X4 sub-regions per tile are employed. 
Because some light and dark regions can be sensed within each 
tile in the second analysis, those sensed regions are taken 
into consideration when searching the database during the 
selection process. 

In the third analysis, resulting in images 112 and 106, 
16 X 16 sub-regions are employed. With 16 X 16 sub-regions, 
the intermediate image 112 is substantially closer to the 
target image 100. Further, image 106 shows that when this 
amount of detail is considered during the selection process, 
more appropriate matches are selected. For example, the 
woman in the first row is the same shape as the vertical 
black bar in the same region of the target image. Further, 
the lizard in another tile matches the diagonal that it was 
compared to. This high-degree of shape matching has a 
powerful effect on the image -forming ability of the final 
mosaic image as information about the contours and shading 
in a target image may transcend the boundaries of each mosaic 
tile. 

In addition to providing improved source image 
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selection, the use of sub- regions results in more uniform 
distribution of color by selecting lover contrast images for 
regions of little high-frequency detail. This can be seen 
in the lower eight tiles of image 106 which are more uniform 
than those selected for image 104. 

Fig. 6 illustrates the effects of number of Bub-regions 
on mosaic image resolution. First and second mosaic images 
144, 116 were generated from a target image 118. The first 
mosaic image 114 was generated with 2x2 sub-regions within 
each tile considered during the source image selection 
process. The second mosaic image 116 was generated with 16 
x 16 sub-regions within each tile considered during the 
source image selection process. The same collection of 
source images was employed to produce both the first and 
second mosaic images. Because of the sub-region analysis, 
different source images were selected to represent some 
corresponding tiles in the first and second mosaic images. 
Further, the Becond mosaic image 116 bears a stronger 
resemblance to the target image 118 than the first mosaic 
image 114, Hence, improved source image selection provided 
through analysis of more sub -regions generates improved 
resolution in the resultant mosaic image. 

In an alternative embodiment, semantic content is 
specified for portions of the . mosaic image. More 
particularly, image sub- categories are specified for use with 
specified tiles of the target image. Hence, the resultant 
mosaic image includes tiles or regions of tiles with 
predetermined categories of images. 

In another alternative embodiment images can be selected 
for assured selection and inclusion in the mosaic image. 
More particularly, the selected images are placed in the 
location of greatest visual similarity relative to the target 
image even if another (unassured) image is determined to have 
greater visual similarity* 

Having described the preferred embodiments of the 
invention, other embodiments which incorporate concepts of 
the invention will now become apparent to one of skill in the 
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art. Therefore, the invention should not be viewed as 
limited to the disclosed embodiments but rather should be 
viewed as limited only by the spirit and scape of the 
appended claims. 



4. Brief description of Drawings 

Pig. 1 is a block diagram of a mosaic image generating 
system; 

Fig. 2 is a block diagram of a database of source 
images ; 

Pig. 3 is a flow diagram that illustrates a method of 
mosaic image generation; 

Fig. 4 is a diagram that illustrates tiles and sub- 
regions; 

Fig. 5 illustrates the effect of sub-region analysis on 
source image selection; and 

Fig. 6 illustrates the effect of sub-region analysis on 
final mosaic image resolution. 
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1- Abstract 

A mosaic image is formed from a database of source 
images. More particularly, the source images are analyzed, 
selected and organized to produce the mosaic image. A target 
image is divided into tile regions, each of which is compared 
with individual source image portions to determine the best 
available matching source image by computing red, green and 
blue channel root-mean square error. The mosaic image is 
formed by positioning the respective best-matching source 
images at the respective tile regions. 



2. Representative Drawing 
Figure 1 



